THE WEIGHTED k–NN WITH SELECTION OF FEATURES AND ITS NEURAL REALIZATION
نویسندگان
چکیده
As a step towards neural realization of various similarity based algorithms k-NN method has been extended to weighted nearest neighbor scheme. Experiments show that for some datasets significant improvements are obtained. As an alternative to the minimization procedures a best–first search weighted nearest neighbor scheme has been implemented. A feature selection method for k-NN, based on a variant of the best–first search strategy, has also been implemented. This method is relatively fast and for some databases gives excellent results. Finally a natural neural network extension of k-NN method is described, including weights and other parameters as a part of the model.
منابع مشابه
A Novel Scheme for Improving Accuracy of KNN Classification Algorithm Based on the New Weighting Technique and Stepwise Feature Selection
K nearest neighbor algorithm is one of the most frequently used techniques in data mining for its integrity and performance. Though the KNN algorithm is highly effective in many cases, it has some essential deficiencies, which affects the classification accuracy of the algorithm. First, the effectiveness of the algorithm is affected by redundant and irrelevant features. Furthermore, this algori...
متن کاملEffective ECG beat classification using higher order statistic features and genetic feature selection
One of the most significant indicators of heart disease is arrhythmia. Detection of arrhythmias plays an important role in the prediction of possible cardiac failure. This study aimed to find an efficient machine-learning method for arrhythmia classification by applying feature extraction, dimension reduction and classification techniques. The arrhythmia classification model evaluation was achi...
متن کاملDifferential diagnosis of CT focal liver lesions using texture features, feature selection and ensemble driven classifiers
OBJECTIVES The aim of the present study is to define an optimally performing computer-aided diagnosis (CAD) architecture for the classification of liver tissue from non-enhanced computed tomography (CT) images into normal liver (C1), hepatic cyst (C2), hemangioma (C3), and hepatocellular carcinoma (C4). To this end, various CAD architectures, based on texture features and ensembles of classifie...
متن کاملافزایش نرخ کارایی طبقه بندی با استفاده از تجمیع ویژگی های موثر روش های مختلف ترکیب شبکه های عصبی
Both theoretical and experimental studies have shown that combining accurate Neural Networks (NN) in the ensemble with negative error correlation greatly improves their generalization abilities. Negative Correlation Learning (NCL) and Mixture of Experts (ME), two popular combining methods, each employ different special error functions for the simultaneous training of NN experts to produce negat...
متن کاملارائه روشی مبتنی بر یک الگوریتم تکاملی برای دستیابی به مدلی کارآمد از شبکه عصبی مصنوعی جهت پیش بینی وضعیت تومورهای پستان
Background and purpose: Intelligent methods such as artificial neural networks (ANN) have been recently used as an efficient model for prediction and classification of tumors. Diagnosis of benign and malignant breast tumors based on morphological, clinical and demographic features without using invasive paraclinical methods is very important. The aim of this study was to provide a neural ne...
متن کامل